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(54) IMAGE RESTORING DEVICE THROUGH ITERATION METHOD, IMAGE RESTORING METHOD AND 
ITS PROGRAM, AND RECORDING MEDIUM 

(57)Abstract: 

PROBLEM TO BE SOLVED: To provide an image restoring device 
and a method to be executed by an iteration method, capable of 
restoring a deteriorated image, without searching the inverse matrix 
of a large-scaled matrix, and realizing the reduction of memory 
consumption and the shortening of a calculating time at image 
restoration. 

SOLUTION: This device is provided with a means 202 for 
calculating the inverted filter of an image deterioration filter, a 
means 502 of calculating a residual pitch image from the 
superimposing arithmetic operation of the image deterioration filter, 
and a residual image, obtained from the predicted image of a 
restored image and the deteriorated image and the inversed filter, a 
means 503 for calculating the correction quantity of the predicted 
image from the residual pitch image; and a means 504 for 
correcting and updating the predicted image from the correction 
quantity. Thus, even when deterioration function indicated by a 
complicated spiral filter is present, reduction of memory 
consumption or the shortening of a calculating time can be realized, 
as compared with a device depending on the inverse matrix of a 
large-scaled matrix. 
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* NOTICES * 

iTPO and NCI PI are not responsible for any 
damages caused by the use of this translation. 

1 .This document has been translated by computer. So the translation may not reflect the original precisely. 

2 **** s hows the word which can not be translated. 
3. In the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] A transposition filter count means to calculate the transposition filter of an image degradation filter, A 
filter storage means to memorize the transposition filter of an image degradation filter, and a remainder image 
count means to calculate a remainder image from an image degradation filter, the prediction image of a 
restoration image, and a degradation image, A remainder inclination image count means to calculate the 
inclination image of the remainder using the convolution operation of a transposition filter and a remainder 
image, Image restoration equipment by the repeating method characterized by having an amount count means of 
corrections to calculate the amount of corrections of a prediction image using the inclination image of the 
remainder, and a renewal means of an image to correct and update a prediction image using the amount of 
corrections. 

[Claim 2] Said remainder inclination image count means is image restoration equipment by the repeating 
method according to claim 1 which comes to use a different transposition filter to the boundary part of an 
image. 

[Claim 3] The transposition filter in said boundary part is image restoration equipment by the repeating method 
according to claim 2 which comes to make the part overflowing from a degradation field into zero. 
[Claim 4] The transposition filter count step which calculates the transposition filter of an image degradation 
filter, The filter storage step which memorizes the transposition filter of an image degradation filter, The 
remainder image count step which calculates a remainder image from an image degradation filter, the prediction 
image of a restoration image, and a degradation image, The remainder inclination image count step which 
calculates the inclination image of the remainder using the convolution operation of a transposition filter and a 
remainder image, The image restoration approach by the repeating method characterized by having the amount 
count step of corrections which calculates the amount of corrections of a prediction image using the inclination 
image of the remainder, and the renewal step of an image which corrects and updates a prediction image using 
the amount of corrections. 

[Claim 5] The transposition filter count step which calculates the transposition filter of an image degradation 
filter, The filter storage step which memorizes the transposition filter of an image degradation filter, The 
remainder image count step which calculates a remainder image from an image degradation filter, the prediction 
image of a restoration image, and a degradation image, The remainder inclination image count step which 
calculates the inclination image of the remainder using the convolution operation of a transposition filter and a 
remainder image, The program for making a computer perform the amount count step of corrections which 
calculates the amount of corrections of a prediction image using the inclination image of the remainder, and the 
renewal step of an image which corrects and updates a prediction image using the amount of corrections. 
[Claim 6] The record medium which recorded the program according to claim 5 and in which computer reading 
is possible. 



[Translation done.] 
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. * NOTICES* 

JPO and NCI PI are not responsible for any 
damages caused by the use of this translation. 

1 .This document has been translated by computer. So the translation may not reflect the original precisely. 

2 **** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates degradation to a record medium at the image restoration 
equipment which presumes the image before degradation (restoration image) with a repeating method from a 
carrier beam image pick-up image and the image restoration approach, and a program list, after acquiring, the 
information, i.e., the degradation function, of image degradation produced in the image picturized with the 
digital camera etc. 
[0002] 

[Description of the Prior Art] Various techniques which restore degradation of an image are proposed to the 
image conventionally acquired as image data using the photo detector array object represented by CCD. An 
image deteriorates by blurring in the case of photography else [, such as aberration which depends on a drawing 
value, a focal distance, a focus location, etc. for the image which says that the image with which degradation of 
an image was actually obtained to the ideal image which should be obtained from the object for an image pick- 
up has deteriorated, for example, is obtained using a digital camera, ]. 

[0003] Restoration which brings the image pick-up image conventionally acquired by modeling degradation of 

an image close to an ideal image has been performed to such an image that deteriorated. 

[0004] In case image restoration is performed, it considers that the vector and degradation function which 

arranged the pixel value for the image perpendicularly in order of the raster are a matrix, and is allied. - It can 

come back to the problem of the solution of degree equation in many cases. That is, if X and a degradation 

matrix are set to H and an acquisition image is set to Y for an image to restore, the relation of a "-one number" 

type can be filled. 

[0005] 

^E^ation 1] 

[0006] Or the image pick-up image Y is an image containing a noise, usually an observation error and a 

discretization error are included in the degradation matrix H, and the least square solution existence of a 

solution was guaranteed to be by the "-two number" type is calculated. 

[0007] 

[Equation 2] 

H f HX=H T Y 

[0008] Both the degradation matrices H and HTH turn into a large-scale sparse matrix to - **. 
[0009] By the way, in the case of easy degradation functions, such as the direction blurring of -, an equation can 
be independently formed to the pixel train of the direction of blurring, the inverse matrix of a blurring matrix 
can be calculated directly, and a solution can be acquired. 

[0010] For example, in the case of slanting blurring, in JP,6-1 18468,A, coming back to the problem of a 
horizontal or vertical blurring is proposed by doubling the direction of an image array in the direction of 
blurring. Asking for an inverse matrix by which the continuity of differential is saved into the boundary part of 
a restoration image is also shown in that case. 
[0011] 
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[Problem(s) to be Solved by the Invention] However, in the degradation function generated in actual blurring, a 
degradation function with which it is expressed with a complicated spiral filter as shown in drawing 16 also 
appears. This is produced, when photoing a night view etc., and the exposure time surely becomes long and 
shutter speed becomes slow. The degradation filter of drawing 16 changes into a two-dimensional filter the 
image degradation information presumed to be generated on 35mm (135mm conversion) of focal ♦***, and the 
photography conditions of shutter speed 1/3. 

[0012] In the case of such a degradation function, it will not be easy to ask for the inverse matrix of the large- 
scale matrices H and HTH, and a repeating method will be used for - ** using the non-dense structure of a 
matrix. In addition, the principle of the image restoration processing by the repeating method is indicated by 
reference "M. Elad and A.Feuer;Super-Resolution of An Image Sequence- Adaptive Filtering 
Approach;Technion-Israel Institute of Technology and 4 April 1997." 

[0013] the inside of a repeating method — YAKOBI — law, a Gauss Seidel iteration method, and SOR — there 
are law, the steepest descent method, a conjugate gradient method, etc. 

[0014] However, in order to refer to HT from Matrix H for every iteration, in memory consumption's increasing 
by any approach, time amount great for count will be spent. 

[0015] It carries out this invention being made in order to solve the above-mentioned problem, and not asking 
for the inverse matrix of a large-scale matrix, either being able to restore a degradation image, offering the 
image-restoration equipment and the image-restoration approach by the repeating method of attaining 
reduction-izing of the memory consumption in restoration processing, and shortening of computation time 
moreover, and providing the record medium which recorded the program and this program which make a 
computer perform still such an image-restoration approach as a technical problem. 
[0016] 

[Means for Solving the Problem] A transposition filter count means by which the above-mentioned technical 
problem calculates the transposition filter of an image degradation filter, A filter storage means to memorize the 
transposition filter of an image degradation filter, and a remainder image count means to calculate a remainder 
image from an image degradation filter, the prediction image of a restoration image, and a degradation image, A 
remainder inclination image count means to calculate the inclination image of the remainder using the 
convolution operation of a transposition filter and a remainder image, It is solved by the image restoration 
equipment by the repeating method characterized by having an amount count means of corrections to calculate 
the amount of corrections of a prediction image using the inclination image of the remainder, and a renewal 
means of an image to correct and update a prediction image using the amount of corrections. 
[0017] According to this invention, the transposition filter of an image degradation filter is calculated, a 
remainder inclination image is called for from the convolution operation of the remainder image called for from 
the image degradation filter, the prediction image of a restoration image, and the degradation image, and said 
transposition filter, and renewal of correction of a prediction image is performed from the amount of corrections 
of the prediction image calculated using the remainder inclination image. 

[0018] Since the above images by which renewal of correction was carried out use, in being realized restoration 
of the degradation image which originates, for example in blurring of a digital camera etc. in the image- 
restoration equipment using a repeating method, while memory consumption decreases rather than it calculates 
depending on a large-scale matrix or an inverse matrix even when restoring an image pick-up image with the 
degradation function with which it can express with a complicated spiral filter from replacing by said filter 
operation, computation time is shortened substantially. 

[0019] In the above-mentioned restoration equipment, a remainder inclination count means may use a different 
transposition filter to the boundary part of an image. Thereby, generating of noises, such as a ringing generated 
near the edge of a restoration image etc., is controlled. 

[0020] In this case, the part which protruded the transposition filter in said boundary part from the degradation 
field may be set as zero. 

[0021] Moreover, the transposition filter count step which calculates the transposition filter of an image 
degradation filter in case said technical problem restores degradation of an image, The filter storage step which 
memorizes the transposition filter of an image degradation filter, The remainder image count step which 
calculates a remainder image from an image degradation filter, the prediction image of a restoration image, and 
a degradation image, The remainder inclination image count step which calculates the inclination image of the 
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. remainder using the convolution operation of a transposition filter and a remainder image, It is solved also by 
the image restoration approach by the repeating method equipped with the amount count step of corrections 
which calculates the amount of corrections of a prediction image using the inclination image of the remainder, 
and the renewal step of an image which corrects and updates a prediction image using the amount of 
corrections. 

[0022] By this image restoration approach, it is little memory consumption and a degradation image can be 
restored in a short time. 

[0023] Moreover, the transposition filter count step to which said technical problem calculates the transposition 
filter of an image degradation filter, The filter storage step which memorizes the transposition filter of an image 
degradation filter, The remainder image count step which calculates a remainder image from an image 
degradation filter, the prediction image of a restoration image, and a degradation image, The remainder 
inclination image count step which calculates the inclination image of the remainder using the convolution 
operation of a transposition filter and a remainder image, The amount count step of corrections which calculates 
the amount of corrections of a prediction image using the inclination image of the remainder, It is solved also by 
the record medium which was solved by the program for making a computer perform the renewal step of an 
image which corrects and updates a prediction image using the amount of corrections, and recorded this 
program and in which computer reading is possible. 

[0024] A computer can be made to perform said restoration processing in these programs and record media. 
[0025] 

[Embodiment of the Invention] Hereafter, the operation gestalt of this invention is explained based on a 
drawing. 

[0026] Drawing 1 is the appearance perspective view showing the digital camera with which the image 
restoration equipment concerning the operation gestalt of this invention was applied, and drawing 2 is the rear 
view of this digital camera. 

[0027] In drawing 1 and drawing 2 , the taking lens 12, the finder aperture 15, the ranging aperture 101, etc. are 
formed in the front face of a digital camera 10, and CCD 13 as an example of the image sensor which receives 
and carries out photo electric translation of the optical image by the above-mentioned taking lens 12 is arranged 
in the interior of a digital camera 10. And the image pick-up means is constituted including a taking lens 12 and 
CCD13. 

[0028] Furthermore, the release (shutter) carbon button 14, the photography mode setting key 18, the liquid 
crystal panel 19, etc. are formed in the top face of a digital camera 10. The insertion opening 17 which can 
insert [ archive media /, such as a memory card, / 16 ] is formed in the side face of a digital camera 10. 
[0029] Looking at the content of a display of a liquid crystal panel 19, further, the photography mode setting 
key 1 8 is used, in case setting out of a zoom etc. is performed, setting out of exposure conditions, such as 
drawing precedence and shutter speed precedence, the change of macro photography, and. 
[0030] Moreover, as shown in drawing 2 R> 2, a liquid crystal display monitor 103, the image-processing 
setting-out key 102, etc. for a live view display are prepared in the tooth back of a digital camera 10. It 
combines with a liquid crystal display monitor 103, and has come to be able to perform decision of the need for 
image restoration processing by the image-processing setting-out key 102. This digital camera 10 can record 
ordinarily the image picturized by CCD 13 as well as the usual digital camera on an archive medium 16. In 
addition to this, it has the image restoration processing facility. A digital camera 10 operates this function 
automatically from the acquired degradation function. Of course, you may make it a digital camera 10 make a 
user judge the need for image restoration processing by the image-processing setting-out key 102 before image 
restoration processing. 

[003 1 ] drawing 3 — the block diagram of a digital camera 1 0 — it is — a thin arrow head — the bold arrow of 
control data — each of image data — flow is shown. 

[0032] 40 is CPU, and it displays exposure conditions etc. on a liquid crystal panel 19 while it memorizes the 
photography conditions at the time of a shutter release 14 being pushed, the established state of the image- 
processing setting-out key 102, etc. Furthermore, while CPU40 drives a taking lens 12 so that it may focus for a 
suitable photographic subject through the taking-lens actuator 46 based on the ranging result from the ranging 
section 44, it is extracted through the drawing actuator 47 and controls 48. 

[0033] Moreover, the analog picture signal from CCD 13 is changed into digital image data by A/D converter 
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41 , and is stored temporarily in an image memory (RAM) 42, and the memorized image data is displayed on a 
liquid crystal display monitor 1 03 by control of CPU40. 

[0034] 50 is the image restoration section which carries out restoration processing of the picturized image, and 
when there is the need for restoration, it restores the image memorized by RAM42. It mentions later for details. 
[0035] 52 is an image degradation information bureau which receives the image degradation information 
acquired from the blurring sensor 104 etc., and as shown in drawing 4 , it is equipped with the transposition 
filter storage section 201 which memorizes the transposition filter of an image degradation filter, and the 
transposition filter count section 202 which calculates the transposition filter of an image degradation filter. 
[0036] CPU40 makes an archive medium 16 memorize the image data by which reading appearance was carried 
out from RAM42 when not performing restoration processing, and when performing restoration processing, it 
makes an archive medium 16 memorize the image restored in the image restoration section. 
[0037] Said image restoration section 50 is equipped with the remainder image count section 501, the remainder 
inclination image count section 502, the amount count section 503 of corrections, the renewal section 504 of an 
image, the image degradation section 505, and the remainder calculation section 506 as functionally shown in 
drawing 5 . 

[0038] The remainder image count section 501 calculates a remainder image from said image degradation filter, 
prediction image of a restoration image, and degradation image, and the remainder inclination image count 
section 502 calculates the inclination image of the remainder using the convolution operation of said 
transposition filter and remainder image. The amount count section 503 of corrections calculates the amount of 
corrections of an image using the inclination image of the remainder, and the renewal section 504 of an image 
corrects the prediction image of a restoration image using the amount of corrections, and it updates. The image 
degradation section 505 degrades the image updated in the renewal section 504 of an image using the 
degradation function at the time of an image pick-up, and said remainder calculation section 506 computes the 
remainder of the image and image pick-up image which deteriorated. 

[0039] Said CPU40 judges whether the remainder computed in the remainder calculation section 506 is less 
than the predetermined threshold. If not less, it is inputted into the remainder image count section 501 , using the 
image after updating as a new processing object (prediction image). Each processing of a correction update 
process of the image by the remainder inclination image count section 502, the amount count section 503 of 
corrections, and the renewal section 504 of an image, degradation of the image by the image degradation 
section 505, and calculation of the remainder by the remainder calculation section 506 is made to repeat until 
the remainder is less than a predetermined threshold. And when the remainder is less than a predetermined 
threshold, the storage media 1 6 are made to memorize by using an updating image (prediction image) as a 
restoration image. 

[0040] The photography and restoration processing by the digital camera 10 are performed as follows. That is, 
first, a user is the photography mode setting key 18, and chooses drawing precedence, shutter speed precedence, 
etc. After setting out of a camera finishes, a user checks a photographic subject and pushes a shutter release 14. 
Then, photographic subject distance is measured in the ranging section 44. Then, based on a ranging result, a 
taking lens 12 is driven so that a suitable photographic subject may be made to focus through the taking-lens 
actuator 46, subsequently, it extracts through the drawing actuator 47 and 48 is set as a suitable value. And it 
integrates with CCD 13 and image data is read. The image data by which reading appearance was carried out is a 
pipelined architecture, is changed into digital data by A/D converter 41 , and is memorized by RAM42 at the 
time of -. 

[0041] The image degradation information acquired from the blurring sensor 104 grade is memorized in the 
filter storage section 201 of the image degradation information bureau 52. 

[0042] Then, image restoration processing is performed using the image pick-up image memorized by RAM42 
in the image restoration section 50. 

[0043] The content of restoration processing is shown in the flow chart of drawing 6 . With the following 
explanation and a drawing, # shows a step. 

[0044] First, the image restoration section 50 is #1 1 and creates the image before degradation required for 
image restoration processing (henceforth an initial image) from the image pick-up image (henceforth an 
extraction image) memorized by RAM42. About creation of an initial image, although the method of 
performing edge enhancement filtering is adopted when the Sharp edge has deteriorated like dotage for 
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example, an acquisition image is not cared about as an initial image as it is, without also performing processing 
of what. 

[0045] The initial image X0 (i, j) is degraded in #12 after initial image creation using the degradation filter h in 
the filter storage section 201 obtained at the time of photography, and a difference (remainder DO) with the 
extraction image Y (i, j) is computed from the following "-three number" type. 
[0046] 
[Equation 3] 

D o=XX|y<i.J)-A*X 0 (i fJ f 

[0047] In addition, in the "-three number" type, "*" collapses and expresses the operation. 

[0048] Next, the initial image X0 (i, j) is memorized to RAM42 by #13 at the time of -. 

[0049] After remainder calculation, by #14, image restoration is performed, the initial image X0 (i, j) is 

updated, and the new image (updating image) XI (i, j) is created from the initial image X0 (i, j) memorized by 

RAM42 at the time of -, the degradation filter h obtained at the time of photography, and the extraction image Y 

(id). 

[0050] Subsequently, the remainder Dl is computed by the X following "-four number" type by #15 from 1 (i, 
j), and the degradation filter h and the extraction image Y (i, j). 
[0051] 
{Equation 4] 

[0052] It judges whether there is any convergence of whether several 5 relation shown below is realized in #16 

and the remainder Dl that is, after calculation of the remainder Dl . 

[0053] 

[Equation 5] 

D n <K^ n«1.2,- 

[0054] If there is no convergence of the remainder Dl (the judgment of #16 is NO), in order to perform 
repeated calculation which is the 2nd time, the initial image X0 (i, j) memorized by return and RAM42 at the 
time of - is deleted to #13, and the updated updating image XI (i, j) is memorized to RAM42 at the time of -. 
Image restoration is performed from the updating image XI (i, j) memorized by RAM42 at the time of -, and the 
degradation filter h and the extraction image Y (i, j) which were obtained at the time of photography, the 
updating image XI (i, j) is updated, and the new updating image X2 (i, j) is created (#14). 
[0055] Like the point, the remainder D2 is computed using the above-mentioned "-four number" type from the 
updating image X2 (i, j), and the degradation filter h and the extraction image Y (i, j) (#15), and it judges 
whether there is any convergence of the remainder D2 from the relation of "a- five number" about the computed 
remainder D2 (#16). If there is no convergence of the remainder D2, it will return to #13 and the same 
procedure will be manipulated again. 

[0056] if there is convergence of the remainder (the judgment of #16 comes out and it is YES), in #17, it will 

carry out a return, using as a restoration image updating image Xn-1 (i, j) memorized by RAM42. 

[0057] The subroutine of said image restoration processing (#14) is shown in drawing 7 . 

[0058] In drawing 7 , the remainder image R (i, j) is calculated by the "-six number" type by #21 using the 

present updating image Xn (i, j), and the degradation filter h and the extraction image Y (i, j) which were 

memorized by the filter storage section 201 . 

[0059] 

[Equation 61 

WJ) = (X n *h-Y)(iJ) 

http://www4.ipdl.ncipi.go.jp/cgi-bin/tran_web_cgi_ejje 6/2 1 /2005 



JP,2002-300459,A [DETAILED DESCRIPTION] 



Page 6 of 7 



[0060] Then, in #22, the inclination image G (i, j) is calculated by the following "-seven number" type by the 
convolution operation with the transposition filter ht memorized by the remainder image R (i, j) and the filter 
storage section 201. 
[0061] 
[Equation 7] 

G(i,j) = {R*h')(iJ) 

[0062] At this time, the thing of a form which is different in the boundary part of a degradation image is used 
for the transposition filter which performs a convolution operation. Thus, in the boundary part of an image, 
generating of noises, such as a ringing generated near the edge of a restoration image etc., is controlled by using 
a different transposition filter. 

[0063] Here, the former image of the size 7*7 shown in drawing 8 deteriorates with the degradation filter of the 
size 3*3 shown in drawing 1 1 , and the case where it becomes the extraction image of 6*6 shown in drawing 9 
is made into an example, and it explains. 

[0064] For example, in the restoration filter field of drawing 10 , the transposition filter A shown in drawing 12 
(A) is used. To the pixel of Yl of the method of -, and drawing 9 , the transposition filter C shown in drawing 
12 (C) is adopted to the pixel of XI of drawing 8 using the transposition filter B shown in drawing 12 (B). That 
is, in case you calculate by collapsing with the transposition filter A in the location from the former image field 
XI of drawing 8 to X49, let the part which separates from the degradation field (from Yl to Y25) of drawing 9 
be zero. 

[0065] Thus, if the part protruded from the degradation field with the transposition filter A becomes zero, the 
image of a non-restoring field will not receive an adverse effect. 

[0066] Then, in #23, a correction image is calculated using the inclination image G (i, j) obtained by the 
aforementioned #22. 

[0067] A correction image can consider various numerical orientation methods with the algorithm which shows 
the updating value for every pixel to the present updating image, and adopts it. If a former image assumes as an 
example that it is a smooth image except near the edge, the correction image D (i, j) will be calculated by the "- 
eight number" type and the "-nine number" type using the steepest descent method. 
[0068] 

g Equation 8] 
(i,j) = *(£A *(V*(A*X fl )) + G)(i\j) 



[0069] 
[Equation 9] 

[0070] However, || and ||2 are the sum of squares of each pixel value of an image, and [0071]. 
[Equation 10] 

It 



[0072] The sum of squares with weight by ** and V is expressed, and V is a weight image showing extent of 
the smoothness to demand. Furthermore, delta is a partial derivation of the second floor called the Laplacian 
filter. Moreover, what is necessary is for beta to be a parameter showing extent of smoothness, for example, just 
to set it to 0. 1 etc. 

[0073] if a correction image is determined — an updating image current in #24 — if it puts in another way, the 
correction image D (i, j) will be added to the current prediction image Xn (i, j) of a restoration image, and it will 
be referred to as new updating image Xn+1 (i, j). 
[0074] That is, it is set to Xn+l(i, j) =Xn(i, j)+D (i, j). 
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[0075] In this way, the degradation image resulting from blurring etc. can be restored by performing repeated 
calculation using the corrected updating image. And even when it has the degradation fUnction with which it 
can express with a complicated spiral filter from replacing by said filter operation, while memory consumption 
decreases as compared with what is calculated in consideration of a large-scale matrix or an inverse matrix, 
computation time is shortened substantially. 

[0076] By the way, in said transposition filter count section 202, a transposition filter is calculated as follows. 
[0077] When the former image shown in drawing 8 is changed to a column vector, it comes to be shown in 
drawing 1 5 . 

[0078] If the degradation filter h shown in drawing 1 1 is changed to a matrix, it will become the three-fold 
block diagonal matrix H as shown in drawing 1 3 . Moreover, each blocks A and B and C itself are 3 -fold 
diagonal matrices, and it has a nested structure. 

[0079] Therefore, when the transposed matrix HT of the above-mentioned three-fold block diagonal matrix H is 
calculated, it comes to be shown in drawing 14 . Accuracy can be asked for the form of a transposition filter as 
shown in drawing 12 from the structure of this transposed matrix HT. 

[0080] In addition, although the above explanation explained as what restores an image with a digital camera 
10, external instruments, such as a computer, may restore the image picturized with the digital camera etc. In 
this case, the program of drawing 6 and drawing 7 is read into a computer through a network or a record 
medium, and is executed on a computer. 
[0081] 

[Effect of the Invention] As mentioned above, this invention calculates the transposition filter of an image 
degradation filter. It asks for a remainder inclination image from the convolution operation of the remainder 
image called for from the image degradation filter, the prediction image of a restoration image, and the 
degradation image, and said transposition filter. It is made to perform renewal of correction of a prediction 
image from the amount of corrections of the prediction image calculated using the remainder inclination image. 
In realizing restoration of the degradation image which originates, for example in blurring of a digital camera 
etc., since an image is restored with a repeating method using this, Even when it has the degradation function 
with which it can express with a complicated spiral filter from replacing by said filter operation, while memory 
consumption is made by decreasing, the computation time for restoration processing can be shortened. 
[0082] Moreover, according to the record medium which recorded the program or this program concerning this 
invention, a computer can be made to perform the above restoration processings. 

[Translation done.] 
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* NOTICES * 
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1 .This document has been translated by computer. So the translation may not reflect the original precisely. 
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